GPT-4V(ision) as A Social Media Analysis Engine

Recent research has offered insights into the extraordinary capabilities of Large Multimodal Models (LMMs) in various general vision and language tasks. There is growing interest in how LMMs perform in more specialized domains. Social media content, inherently multimodal, blends text, images, videos, and sometimes audio. Understanding social multimedia content remains a challenging problem for contemporary machine learning frameworks. In this paper, we explore GPT-4V(ision)'s capabilities for social multimedia analysis. We select five representative tasks, including sentiment analysis, hate speech detection, fake news identification, demographic inference, and political ideology detection, to evaluate GPT-4V. Our investigation begins with a preliminary quantitative analysis for each task using existing benchmark datasets, followed by a careful review of the results and a selection of qualitative samples that illustrate GPT-4V's potential in understanding multimodal social media content. GPT-4V demonstrates remarkable efficacy in these tasks, showcasing strengths such as joint understanding of image-text pairs, contextual and cultural awareness, and extensive commonsense knowledge. Despite the overall impressive capacity of GPT-4V in the social media domain, there remain notable challenges. GPT-4V struggles with tasks involving multilingual social multimedia comprehension and has difficulties in generalizing to the latest trends in social media. Additionally, it exhibits a tendency to generate erroneous information in the context of evolving celebrity and politician knowledge, reflecting the known hallucination problem. The insights gleaned from our findings underscore a promising future for LMMs in enhancing our comprehension of social media content and its users through the analysis of multimodal information

Ship–Infrastructure Cooperation: Survey on Infrastructure Scheduling for Waterborne Transportation Systems

Ship–infrastructure cooperation, i.e., infrastructure scheduling, is significant for optimizing the utilization of spatial-temporal resources of infrastructures and improving the efficiency and safety of waterborne transportation systems. This paper carries out a systematic review of the scheduling problems of the infrastructures in waterborne transportation systems, including locks, terminals, berths, and waterway intersections. The infrastructure scheduling problems are linked to the classical optimization problems, and a generalized infrastructure scheduling problem is formulated. For lock scheduling, the ship placement sub-problem aims at minimizing the number of lockages, which is a kind of classic 2D bin packing problem; the lockage scheduling sub-problem deals with chamber assignment and lockage operation planning, which is modeled as a single or parallel machine scheduling problem. For berth and terminal scheduling, the idea of queuing theory (for discrete terminal) and 2D bin packing (for continuous terminal) are usually applied. Most research aims at minimizing the waiting time of ships and focuses on the continuous dynamic terminal scheduling problems. As a special infrastructure, the waterway intersection receives little attention. Most research focuses on traffic conflicts and capacity problems. Future research directions are provided based on the review results and problems of infrastructure scheduling in practice

Switchable Interlayer Magnetic Coupling of Bilayer CrI3

Due to the weak van der Waals (vdW) interlayer interaction, interfacial geometry of two-dimensional (2D) magnetic vdW materials can be freely assembled, and the stacking order between layers can be readily controlled, such as laterally shifting or rotating, which may trigger the variation of magnetic order. We investigate the H-type bilayer CrI3 where the two layers are aligned in anti-parallel directions. Based on first-principles calculations, we propose two states with different interlayer magnetic couplings, i.e., ferromagnetic and antiferromagnetic, and analyze the superexchange mechanism inside. It is found that the two magnetic coupling states are stacking-dependent, and could be switched by applying out-of-plane axial strain and electron doping. Our findings show great application potential in the design of heterostructural and spintronic devices based on 2D magnetic vdW materials